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Abstract 


<1 

The  problem  of  nonparametric  estimation  of  a  bivariate  survivorship 
function  with  doubly  censored  data  is  considered.  A  self-consistent  esti¬ 
mator  is  developed  by  first  ^'reducing*1**  the  problem  to  that  of  estimation  in 
a  singly  and  right  censored  situation  .  This  estimator  is  shown  to  satis¬ 
fy  a  likelihood  equation,  and  its  uniqueness  is  investigated.  The  results 
obtained  naturally  parallel  those  obtained  by -Campbell  (ICHH^  in  the  sing¬ 
ly  censored  case. 

y 
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Nonparametric  Estimation  of  a  Bivariate 
Survivorship  Function  with  Doubly 
Censored  Data 


1.  Introduction  and  summary.  In  this  article  we  consider  the  nonpara¬ 
metric  estimation  of  a  bivariate  survivorship  function  when  data  may  be 
both  left  and  right  censored.  Specifically,  let  = 

be  n  pairs  of  true  lifelgngths  where  some  of  the  T„'s  are  left  cen¬ 
sored  and  some  right  censored.  Thus,  not  all  are  exact*f 

observable.  For  each  j  (1  <  j  <  n)  and  for  i  =  1,2  ,  we  assume  that 


there  are  limits  of  observation  L. .  and  U. . (L. .  <  U..)  which  are 

lj  ij  ij  -  ij 

either  random  variables  independent  of  each  other  and  or  are 

fixed  constants.  The  recorded  information  is 


X.j  =  max[min(T^  ,IL  ^) ,  L.^],  i  =  1,2,  j  =  l,...,n  . 

Also,  for  each  j  =  l,...,n  and  i  =  1,2,  it  is  known  whether  X..  =  L. . 

lj  ij 

(i.e.  T.  .  <L..  and  T.  .  is  left  censored  or  a  "late  entrv") .  or 

13  -  ij  ij  7 

X. .  =  U. .  (i.e.  T. .  >  U. .  and  T. .  is  right  censored  or  a  "loss"), 

ij  13  13  13  13 

or  X. .  =  T. .  (i.e.  L. .  <  T. .  <  U. .  and  T. .  is  a  "death") . 

13  13  13  13  -  13  13 

Recently  Campbell  (1979)  considered  the  problem  when  observations  are 
randomly  and  right  censored.  He  developed  a  "self-consistent"  (SC)  non¬ 
parametric  estimator  and  showed,  among  other  things,  that  the  SC  satisfied 
a  nonparametric  likelihood  equation  and  was  unique  up  to  the  final  censored 
values  in  any  dimension.  A  similar  SC  estimator  was  developed  and  studied 
by  KorwaT  and  Dahiya  (1979).  Here  we  extend  Campbell's  results  to  the 
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situation  of  doubly  censored  data.  Earlier,  Turnbull  (1974)  considered 
the  univariate  situation,  and  used  an  ingenious  approach  to  "reduce"  the 
doubly  censored  situation  to  the  right  censored  one  for  which  the  Kaplan- 
Meir  (KL)  (1958)  estimator  was  readily  applicable.  In  extending  Campbell's 
results  here  we  use  the  very  same  approach  of  Turnbull,  though  modified, 
of  "reducing"  the  doubly  censored  situation  to  that  of  the  right  and  singly 
censored  one. 

Assume,  then,  that  there  is,  for  each  component  of  the  bivariate  variable, 

a  natural  discrete  time  t._=0<t.,<...<t.  ,  i  =  1,2.  (This  is  an 

xO  ll  lm. 

i 

appropriate  assumption  to  make  if  observations  are  made  only  at  discrete 
times.)  Alternatively,  we  might  assume  that  they  are  grouped  and  for  each 
rectangle  (t^  ^.t^]  x  (t^  ^.t^]  we  ^ave  t*ie  following  information 
available: 

6..  =  #  of  pairs  (T,,,T-.)  such  that  t,.  .<  T,,  <  t, 
ij  v  v  Ik*  2k'  li-l  lk  —  l,i 

and  t2j  i  <  T^  <  tjj  ("double  deaths"); 

cu  j  =  #  of  pairs  »T2k^  suc^  t^at  Tik  >  Tli  anc* 

t2j-l  <  T2k  -  t2j  loss  in  the  first  component  and  death 
in  the  second"); 


Sjj  =  #  of  pairs  (Tlk,T2k)  such  that  tu  i  <  TJk  <  t^ 


and  T2k  >  t2j  ("death  in  the  first  component  and  loss 
in  the  second") ; 


A.j  =  #  of  pairs  (Tlk»T’2k)  such  that  Tlk  >  t^  and  T2k  >  t^ 

("double  losses"); 

=  #  of  pairs  (Tlk,T2]{)  such  that  Tlk  <  tj.  and  T2k  <  t2j 

("double  late  entries") ; 


3 


Vij  ’  '  of  PairS  (Tlk’ V  such  that  Tlk  *  'll  T2k  i  «2j 

("loss  in  the  first  component  and  late  entry  for  the  second"); 

yij  =  #  0f  Pairs  ^Ik'V  SUCh  that  Tlk  1  hi  and  T2k  "  t2j 

("late  entry  for  the  first  component  and  loss  in  the  second"); 

yh  =  #  Of  pairs  (Tlk>T2k)  such  that  <  Tlk  1  and 

T^j.  _<  t^j  ("death  in  the  first  component  and  late  entry  in 
the  second") ;  and 

yh  =  #  of  pairs  (Tlk>T2k)  such  that  Tlk  1  and 

1 j  <  T^  t ^ j  ("late  entry  for  the  first  component 

and  death  in  the  second") . 


As  in  Turnbull  (1974),  we  assume  that  each  of  the  late  entries  yf.  or 
5  2  4 

yijf(yir  or  y„)  in  the  first  (second)  component  occurs  at  the  end  of 

the  interval  (t^  j>t2j])>  t^iat  each  of  the  double  late 

entries  yh  (double  losses  1,  ;  ,  j)  occurs  at  the  right  hand  top  (left 

hand  botton)  corner  of  the  rectangle  (t^  j,t^]  *  Ct2j  Finally, 

2  3 

we  also  assume  that  each  of  the  a. .  or  y. .  (B. .  or  y. .)  losses 

ij  ij  ij  i  r 

in  the  first  (second)  component  occurs  at  the  beginning  of  the  interval 

(t  .  t  1  ((t  ]).  Alternative  assumptions  are  also  possible  which 

14-1*  li  2j-l’  2jJ  r  ^ 

we  do  not  pursue  here. 

We  desire  to  estimate  F„  =  P[T^  >  t^,T0  >  t2j]»  i  =  0,...,m^, 


j  =  0, . . . ,m2  . 

2.  The  Self-consistent  estimator.  We  first  reduce  the  problem  to  that  in 
which  there  is  only  right  censoring.  To  this  end,  consider  first  the  yj^ 
double  late  entries  at  (tii,t2j)‘  these,  the  expected  number  of  double 


4 


deaths 


in  the  rectangleCtj  ^  ^tj.,]  x  (t2  ...  for  i’<i,  j'<j, 


is  estimated  by  yj^  kj^,  where  k?^  is  an  estimate  of 

PtV,i'-l<T.  <T2it2jl  TlitH-T2i'2jl  -h’i'1  hi- 

-here  6.,.,  -  F. ,  j  j -  Fi.,j  •-!  *  Fi'.j"  Pij  *  1  *  F0.j 

"  Fi,0  +  Fi,j’  and  Fij  =  P^T1  >  tli’T2  >  t2 *  Similarly.  of  the 

4  5 

y..(y..)  single  late  entries,  the  expected  number  of  double  deaths  in  the 

J  J 

rectangle  -  ( t2, j ’ -1* F2j ' ]  is  estimated  by  -jj  kf . Cu^ - 

-here  kf(kFj)  is  an  estimate  of  P [t]i_1  <  Tj  <  t^.t^.  j  <  T;  <  t2 

I  *11-1  <  \i-hi-  T2  >V  -  4ij'/(RiO  -  V  (PItl.i'-l  <  Tli  hi-.h.i-l 

VtQoj  -V5’  "h"e  V(Vj5 

is  defined  above  and  R. .  =  F.  ,  .  -  F . . (Q. .  =  F .  .  ,  -  F .  .)  .  Of  the 

lj  l-l, j  ij  ij-l  1JJ 

3  2  - 

^ij^ij)  sin8le  late  entries,  the  expected  number  of  deaths  in  the  rectangle 

(t  ,,t  .,]  x  (t.,00)  is  estimated  by  y?.k?.  (y?.k?.)  where  k'^.(k2.) 
l,i'-l  li,J  J  ij  i)i]  ij  ij  ij 

is  an  estimate  of  <  tu,,  T2  >  t.  |  T][  <  tu>  T2  >  t^]  = 

Ri',/<F0J  -  Fi,j)  (P1T1  ’  'li-hr-l  “  T2i*2J'l  T1  >  'll’  T2i'2j]  ■ 

Q..,/(F.  -  F.  0).  Now,  consider  the  "reduced"  singly,  right  censored 

1  j  1 ,  u  1,  j 

problem  with 


6.’.  =  6..  +  E  y1.  A.  ./p.  ,  . ,  +  E  y 7 . ,  A../(R.  .  -  R.  .,)  ♦  E  y.,.A../(Qn  .-Q.,.) 
13  !J  i,>i  iJ  iJ  i'j'  XJ'  iJ  1.0  1  it>i  i'J  ij  vx0,i  xi'j', 

(2.1) 


“lj  ’  “ij  *  ,fa  4}'  V(fi,o  -  fi,j'>-  8ij  ■  8ij  *  ,*  "i-j  V(Foj  -  Fi-j>  • 


X! .  =  X.  . 


11  IJ 

where  the  caret  over  a  probability  denotes  an  estimate  of  the 
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corresponding  probability.  From  Campbell  (1979)  a  nonparametric  estimator 
Fij  of  ”  P [Tj  >  >  satisfies  the  self-consistency  equation 

-  Q- .  R  • . 

nF!  =  N  *  Z  a*  ♦  Z  B’ 

J  ij  z>.  kx,  k>.  k£ 

k<i  £<j 


(2.2) 


+  y  a  <  max(i,k) ,max(i,£) 

\rQ  * 

k<i  KX'  F' 

or  £<j 


k£ 


N.  .  =  I  (S' 
i]  k£ 


*  r“u  -  £ek  *££'u 


k>i,£>j  k>i,£>j  k>i,£>j  k>i,£>j 

A 

Following  Efron  (1967)  we  say  that  the  estimates  (F. .}  are  self-consistent  if 

y\  ^ 

F,-,-  =  Fi  i  •  T^US  t^ie  self-consistent  estimates  F..  satisfy 
iJ  ij  ij  1 


(2.3) 


"’FiJ  ’  Nli  *  £  “in  7?'  Kz  r1  *  £ 


ij  k£  T  .  *  pk£  b  ,  . 

pj  V  k>1  k£  k<i 

k<i  £<j  or  £<j 


■  k£ 


where  (o^,  ^k£,kK£^  anc*  Nij  are  given  by  (2.1)  and  (2.2)  respectivel> 

and  where  Q . .  =  F.  .  -  F..  and  R. .  =  F.  ,  .  -  F. .  . 

ij  i,l-l  13  13  l-l,)  i) 

An  obvious  iterative  procedure  to  compute  the  F„  's  is  as  follows: 

(1)  Start  with  the  empirical  distribution  function  {F? . }  ,  F? .  =  N  /n 

ij  ij  i) 

as  the  initial  estimators. 

(2)  Form  ar,d  >  as  described  above,  using  {F?.} 


ij  ij  ij  ij 

A  1 

(3)  Obtain  improved  estimates  {F/\ }  by  using 


ij 

Q° 

nF.1.  =  N.  .  +  Z  a'  +  Z  B  — 

13  13  £>j  k£  -0  k£  SO 


R.°. 

.  Jll 


k<i 


Qk£  "k* 

*<3  -0 

+  V  A'  max(i,k),max(i,£) 
L  k  £  ~ n 


k<i 

/>■**  0  *  A 


k£ 
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(4]  Go  to  step  (2)  with  {F? . }  in  place  of  {f?  }  etc. 

(5)  Stop  when  the  requirements  on  the  accuracy  are  met.  Convergence  could 
be  faster  if  we  started  with  the  Campbell  estimates  {F°0}  satisfying  (2.3) 
without  the  dashes. 


3‘  ZlPPerties  of  the  SC  estimator.  In  this  section  we  state  and  prove 
some  important  properties  of  the  self-consistent  estimates  (F. .}  (2.3). 

These  properties  naturally  parallel  properties  for  Campbell's  (1979)  estimates 
for  the  right  censoring  only  situation. 

The  likelihood  function  L  is 


(3.1) 


Vm2  6..  a..  8.  X  u1  ,2 

i=l , j=l  1J  1J  1  iO  ij'  ^Fo,j 


Fi/ij{Ri(fRi/ij 

5 

■%i  -  Vu 


and  the  likelihood  equation  obtained  by  partially  differentiating  tnL  »ith 


respect  to  F„  and  setting  it  to  zero  is 
5..  6.  .  .  <S.  _  .  (S  1 


id  13  i.M  Vi.j  Vi.j.j  rij  Qij  Qij.,  Rij 

♦  —iu- » v-ix  _  Hii _ Mij  .  “ii _ “j.i.i 

i‘l.j  Pij  F10'Fij  F0j'Fij  Rio-Rij  Ri.l.o'Ri.l.j 

5 

Uij+1 


Q0j'Qij 


Qoj+rQij+i 


(3.2) 


+  +  !ii  .  ii  + 


4 

h+i,j 


—  +  ^  +  —tj _ .  l+i.j 

1  1*1,1  Qil  pij  Fi<fFiJ  Ri0-Rij  Ri.l,o*Ri+l,j 


•  0  , 


mk=  _*i±  +  ai.j+i  +  !ii  + 

«*,  R,.  Pt'. 


1  3 

Mi-t  Mi  i 


i,j+I 


u  “i.M  "i;  pij  Vu  V"iJ  WV.., 
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We  are  now  ready  to  prove 


Theorem  1 :  Any  self-consistent  solution  {F.j}  of  (2.3)  will  also 

satisfy  the  likelihood  equation  (3.2)  with  (F.  .  ,6. .  ,R. .)  in  place  of 

ij  ij  ij  v 

(F. .,Q..,R. .). 

13  xij  ly 

Proof:  Recast,  using  (2.1),  the  likelihood  equation  (3.2).  This  is 
easily  seen  to  be 


!k  -  ILiil  .  filLJ.  *  .  )ii  .  !ii  .  !Li±i  .  !ii  .  finj. 


A.  . 
11 


A. 


i,j  +  l 


A. 


i+l.j 


A. 


S'  S'.  a'. . 

11  i  1+1 i  11  -  n 

t:  +  a777  +  qt*  -  0 

ll  1+1,1  xll 

S'  s;  .  ,  g» 

±L  +  -AO.+.1.  +  JLL  =  o 

A  .  A,  .  ,  R  . 

13  1,3  +  1  13 


i+l,j+l 

and 


F.  . 
13 


Qi3 


Q: 


i,3  +  l 


R.  .  R.  ,  . 
ii  1+1,3 


=  0 


The  rest  follows  from  Theorem  2  of  Campbell  (1979).  □ 

Turning  to  the  existence  and  uniqueness  of  a  solution  of  (2 .3 ) ,  one 

A 

might  ask  whether  there  exists  at  all  a  solution  (F„)  of  (2-3)  and  if 
so  is  it  unique?  The  difficulties  are  similar  to  those  encountered  in  the 
singly  and  right  censored  case.  For  a  discussion  and  a  conjecture  about 
existence,  see  Campbell  (1979).  The  following  theorem  is  aimed  at  the 
uniqueness  question: 


32  nL 

Theorem  2:  The  matrix  {-  ^ — }  is  nonnegative  definite. 

d  ijd  k£ 


Proof :  Write  the  likelihood  (3.1)  as 


=  Iq  L  2 
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where 


6. .  X. .  a. .  g.  . 

L.  =H  A.JJ  F.V  q.y  R.^ 
1  fjj  iJ  ij  xiJ  13 


and 


(3.3) 


Hi. 


3 

V** 


4 

JJ. , 


J2  =P.  Pi3'(FiO-Fi3)  (FOj-Fi3)13(RiO-Rij)  ^Oj^ij5 

1  ’  J 


92J£nL, 

Now,  Campbell  (1979)  has  shown  (his  Theorem  3)  that  the  matrix  {-  7r= — 

is  non-negative  definite.  Thus  it  suffices  to  show  that  {-  tt= — ttp — ) 

3F.  .  3F 
13  kS, 

also  is.  From  (3.3)  and  the  definitions  of  p..,  Q. .  and  R..,  letting 

13  13  13 

32£nL2  , 

-  -  =  M, .  .  w,  ...  ,  we  find  that 


3Fii9Fk£  Cij) CkH) 


w  1  2  3  4  4  5  5 

M,.  ...  , .  ...  =  m..  +  m..  +  m..  +  m.  .  +  m.  ,  .  +  m..  +  m.  .  ,» 
(13)  (13)  13  13  13  ij  1  +  1,3  13  1,3  +  1 


M  ...  =  -  m..,  M,..w.  .  ..  =  -  nu  . ,  M  =0  if  I  i-k I  + 1 3 -£ I >2, 

(13)  (i_l , 3 )  13  (13)  (i»3-l)  13  C13)  (k«.)  1  1  IJ  ’ 

4  1  2  4  4  4 

.  =  m..,  M. .  =  -  (m.  .+m.  ,+m.  ,+m.  ,  . ),  ,  ..  =  m.  ,  .  , 

(13) ( 1-1,0)  13’  (13) (i0)  13  13  13  1+1,3  (13) (i  +  l,0)  1  +  1,3 

•  n  =  m5-,  M,...  =  -(nu  .+m?.+nu.+nu  .  M,.  .Wrt  .  . .  =  nu  .  ,, 

(13) (0, 3-I)  13  (13) (O3)  13  13  13  i,3  +  l  (i3)(0,i+l)  i,3  +  l 


M(ij)(k0) 


=  0  if  I i”k  1—2,  M(ij)  (OH) 


=  0  if  |j-&|  2  , 

5 


M(0j)(0j,  •  H(0j)(0,j-1)  ■  -  "ij  • 

M(0j)  (i0)  ■  "ij’  M(0j)(0«)  '  0  lf  ~2’ 

1  2  4  4  4 

(i0)(i0)  13  13  13  1+1,3’  (10) (1-1,0)  13’  (1O) (kO) 


=  0  if  |k-i|  >2 


ms  PAGE  1  (  QUALITY  PRACTICABLE 

JRdiM  Cttt  1  x  i'.  ..i.  :  ....  TO  UGC 


9 


where 


112??  2  x  x  ? 

mt.  =  yf./pT.,  mf.  =  yf./(F.n  -  F . .)  ,  m7.  =  y7./(Frt.  -  F .  . )  ^  , 

ij  ij  Kij  ij  ij  iO  lj'  ’  ij  ij  Oj  ijJ  ' 


4  4  25  5  2 

m“.  =  y?./(R.n  -  R.O  ,  m  •=  y7./(Q_.  -  Q.  .)  . 

ij  lj  lO  ijJ  ’  ij  Kij'  xij' 


Note  that  M(as  well  as  the  matrices  to  follow)  is  m x  m,  where  m  =  m^n^  +  m^  +  m. 

Now  decompose  M  as  follows:  Let  be  the  matrix  with  l's  at  (0j)(0j), 

(Oj) (iO) ,  (iO) (Oj) ,  (iO)(iO),  (ij)  (ij) ,  -  l’s  at  (Oj) (ij) , (iO) (ij) , (ij) (iO) , 

2 

and  0’s  everywhere  else.  Let  A„  be  the  matrix  with  l's  at  (iO)  (iO) , 

(ij)  (ij),  -l's  at  (iO)(ij),  (ij) (iO)  and  0's  everywhere  else.  Let  A)\ 

be  the  Matrix  with  l's  at  (0 j )  (Oj ) ,  (ij)(ij),  -  l's  at  (Oj) (ij) ,  (ij,0j), 
and  0's  everywhere  else.  Let  A^.  be  the  matrix  with  l's  at  (0, j-1) (0, j-1) , 

(0, j-1) (ij) ,  (Oj) ((Oj) , (Oj) (i, j-1) ,  (i, j-1)  (Oj) ,  (i, j-1) (i, j-1) ,  (0, j-1) (ij) , 

(ij)  (ij) ,  -l’s  at  (0, j-1) (Oj) ,  (0, j-1) (i, j-1) ,  (Oj) (0, j-1) ,  (0, j)  (ij) , 

(i, j-1)  (0, j-1) ,  (i, j-1)  (ij) ,  (ij)  (Oj) ,  (ij)  (i, j-1) ,  and  0's  everywhere  else. 

4 

Finally,  let  A.,  be  the  matrix  with  l's  at  (i-1,0) (i-1,0) ,  (i-1,0)  (i, j) , 

(iO) (iO) ,  (iO)  (i-1, j) ,  (i-1, j) (iO) ,  (i-1, j) (i-1 , j)  ,  (ij) (i-1,0) , (ij)  (ij) ,  -  l's 
at  (i-1,0) (iO),  (i-1,0) (i-1, j),  (iO) (i-1,0),  (iO) (ij) ,  (i-1, j) (i-1,0) ,  (i-1, j) (ij) , 
(ij) (iO) ,  (ij) (i-1, j) ,  and  0's  everywhere  else.  It  is  easily  verified  that 
m2  ml  ^  k  k  k 

M  =  I  Z  Z  m. .  A. .  .  Since  y..'s  are  nonnegative  numbers,  the  proof 

j=l  i=l  k=l  1J  1J  1J 

k  .  .  2 

will  be  complete  if  we  show  that  each  A^ .  is  nonnegative  definite.  A^, 


LJ 


and  A?..  are  obviously  nonnegative  definite.  The  highest  order  nontrivial 
principal  minor  of  a|L  is  a  third  order  determinant  with  two  identical  rows, 
all  the  second  order  principal  minors  of  this  determinant  vanish;  and  the 
main  diagonal  has  l's  on  it.  Hence  A^  is  also  nonnegative  definite. 
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highest  order  nontrivial  principal  minor  of  A4  (A5  )  is  a 

ij  i  j 

determinant  which  has  two  pairs  of  identical  rows.  Hence, 
itself  and  all  its  principal  minors  of  order  three  vanish.  The  second 
order  principal  minors  of  this  determinant  all  vanish,  and  the  entries  on 
the  main  diagonal  are  all  l's  .  □ 

Theorem  2  implies  that  the  likelihood  L  (3.1)  is  convex  in  the  F  's 

ij 


Finally,  the 
fourth  order 
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